Testing an image display device 
Field of the invention 

This invention relates to testing an image display device and has particiJar but 
not exclusive application to testing a liquid crystal display (LCD) device when 
installed in electronic apparatus such as a mobile telephone handset. 

Background 

Conventional mobile telephone handsets include a keypad and an LCD display 
device which are provided with internal back Ughting which is switched on for 
a period when the keys are operated. During manufacture, the mobile 
telephone handset undergoes a functional test to determine that the LCD 
display device operates satisfactorily. 

The functional testing involves applying test signals to the handset from an 
external test signal generator, which causes the LCD device to be switched on. 
An electronic image capture device is used to record an image of the handset 
under test and the resulting image is processed according to a highly complex 
analytical technique to determine whether the LCD is functional. Analysis of 
the captured image is complex due to the fact that the LCD is subject to back 
and other spurious Ughting that varies in a non- linear manner across its 
display area. 

The present invention seeks to provide an improved, simpler approach. 
Summary of the invention 

According to the invention there is provided a method of testing functionality 
of an image display device that comprises a matrix of image elements that are 
individually energisable in a graphical display, the method comprising 
capturing data corresponding to first and second images of the display 
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provided by the device under different test conditions thereof, and utilising 
the image data for the first and second images to identify a malfunction of the 
device. 

According to the invention, malfunctions can be identified simply and 
effectively from the data for the first and second images. 

The elements of the display device maybe energised and de-energised 
individually to produce the data corresponding to the first and second images 
such that elements energised for the first image data capture are de- energised 
for capturing the second image data. 

The data corresponding to the first image may be captured when all of the 
image elements are energised with the data corresponding to the second image 
being captured when none of the image elements are energised. 

Alternatively the data corresponding to the first and second images maybe 
captured when alternate ones of the matrix of image elements are energised 
and de- energised and such that elements energised for the first image data 
capture are de- energised for capturing the second image data. Other 
energisation patterns for the elements may be used in accordance with the 
invention. 

The image data for the first and second images may be compared e.g. by 
subtraction to derive resultant data corresponding to the functionality of the 
elements individually and the resultant data may be combined e.g. by 
sunamation, for at least a part of an individual one of rows or columns of the 
elements. The combined data may then be compared with a threshold to 
provide an indication of a malfunction in the device. 

The value of the threshold may be determined as a function of the resultant 
data, for example a weighted combination of the mean and standard deviation 
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of the values of the resukant data included within the individual row or 
column or part thereof. 

The display device may comprise a liquid crystal display device and image data 
may be captured with an electronic camera. 

5 The display device mav have a back light operable to illuminate the display 
device, and the methocmnay include capturing the data corresponding to the 
first and second images ^th the back light in use, although external 
illumination may used f orVhis purpose. 

The invention also provides apparatus for testing functionality of an image 
10 display device that comprises a matrix of image elements that are individually 
energisable in a graphical display, the apparatus comprising an optical image 
capture device configured to capture data corresponding to first and second 
images of the display provided by the device under different test conditions 
thereof, and a processor configured to utilise the image data for the first and 
25 second images to identify a malfunction of the device. 

The invention also includes a computer program operable to cause the image 
data for the first and second images to be compared so as to identify a 
malfunction of the device. 

The program may be configured to cause the processor to compare the image 
20 data for the first and second images so as to provide resultant data 

corresponding to malfunctions occurring individually in an array of regions of 
the device configured in rows and columns, to combine the resultant data for 
at least part of an individual one of the rows or columns, and to compare the 
combined data with a threshold to provide an indication of a malfunction in 
25 the device. 



Brief description of the drawings 
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In order that the invention may be more fully understood an embodiment 
thereof will now be described with reference to the accompanying drawings, 
in which: 

Figure 1 is a schematic illustration of a functional testing station for mobile 
telephone handsets, for testing them at the time of their manufacture; 

Figure 2 is a schematic plan view of a mobile telephone handset LCX> display 
device showing its matrix of electrodes; 

Figure 3 is a schematic sectional view taken along the line A- A* of Figure 2; 

Figure 4 is an enlarged, schematic view of the electrode arrangement shown in 
Figure 2; 

Figure 5 is a schematic diagram of a matrix of image data derived by the image 
capture process; 

Figure 6 is a schematic illustration of an LCD with a line failure in one of its 
vertically extending electrodes; 

Figure 7 is a schematic illustration of summation graphs for the vertical 
columns of image data derived from the image capture process for the device 
of Figure 6, together with a graph of a variable threshold and 

Figure 8 is a flow chart for the LCD functional testing process. 

Detailed description 

Referring to Figure 1, mobile telephone handsets MSI, MS2, MS3 are 
illustrated moving along a conveyor belt 1 through a testing station 2 shown 



in schematically hatched outline, where functional testing is carried out at the 
time of manufacture of the handset. 

As well known in the art, each mobile telephone handset MS 1,2,3 includes a 
microphone 3, keypad 4, LCD display 5, an earpiece 6 and an antenna 
configuration 7 which is contained within its housing. The handset also 
includes microprocessor controlled circuitry (not shown) which has external 
plug connections 8 on its imderside. 

When the mobile station MS moves into the testing station 2, a robot arm not 
shown, inserts electrical leads 9 shown schematically into the plug connection 
8 so as to connect the handset to an external electrical test signal generator 
10. When the testing is completed, the robot arm removes the leads 9 and the 
conveyor belt 1 moves so as to bring the next handset MS into the testing 
station 2. 

Amongst other things, the test signal generator 10 carries out a functional test 
of the back Hghting for the keypad 4 and the LCD device 5. As part of this 
process, the LCD device 5 is energised to ensure that it is operating correctly, 
as will be explained in detail. 

An analogue or digital camera 11 captures image data concerning the display 
provided by the device 5 in the handset under test and the data are supplied to 
a processor 12 having an associated control program 12a which provides an 
output 13 which indicates whether the handset has passed or failed the 
functional testing. Preferably the camera 11 has sufficient resolution to give 
at least four camera image pixels for each pixel of the LCD 5, in the capture 
image data. 
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The LCD 5 is shown in more detail in Figures 2 and 3. As well known in the 
art, a liquid crystal display device comprises liquid crystal material 14 
sandwiched between transparent plates 15,16 typically made of glass, on 
which arrays of parallel electrodes are formed. Electrodes 17 on plate 15 
5 extend orthogonally of electrodes 18 formed on plate 16. The electrodes 
17,18 typically comprise metalisation strips which are formed by selective 
etching from a metallic layer deposited onto the glass plates 15,16. As well 
known in the art, elemental display areas are defined at the regions where the 
O orthogonally disposed electrodes 17,18 cross over. Figure 4 illustrates an 

fy 10 enlarged plan view of a portion of the electrode configuration and it can be 

1^ seen that when electrodes 17', 18' are energised, i.e. each receive an 

^ energisation voltage +/ -V respectively, the optical characteristics of the liquid 

2 crystal material between them changes such that the display becomes opaque 

□ rather than translucent. Energisation of only one of the electrodes 17 or 18 

15 does not produce a change in opacity. Thus, by selectively energising 
2 electrode pairs, such as electrodes 17'18', a display can be provided selectively 

at the element defined by the crossover of electrodes as viewed in Figure 4. 



The elemental display areas or pixels can be defined in terms of a Cartesian 
20 co-ordinate system i,j as shown in Figure 2. Referring to Figure 4, pixel 
positions (i,j); (i-l-l,j); (i,j-l) and (i+l,j-l) are shown. 



Sometimes during manufacture, the metalisation layers 17,18 are imperfectly 
formed and may include a discontinuity 19 as illustrated in Figure 4 in relation 

25 to electrode 17'. This renders pixels lying along the electrode 17' inoperable 
where the electrode 17' is cut off from its voltage supply V. Thus, in the 
example shown in Figure 4, the pixel i,j will be operable whereas pixel i,j- 1 
will not operate due to the discontinuity 19. It will also be understood that 
pixels may not operate due to other failures in the manufacturing process, e.g. 

30 a bad electrical connection to the electrodes 17,18, 



The testing carried out at testing station 2 determines whether the pixels of 
the display device are operating satisfactorily. The test signal generator 10 
applies first and second test signals to the electrodes 17,18 such as to provide 
first and second test signal patterns sequentially. For each pixel, the test 
signal patterns are arranged so that the pixel is switched on in one of the test 
patterns and off in the other test pattern. For example, in the first test 
pattern all of the pixels may be switched on and then all of them may be 
switched off in the subsequent, second pattern. However, many other 
different test patterns can be used. For example, next adjacent pixels maybe 
switched on and off in the first pattern, such that the pixel that is switched on 
in the first pattem is switched off in the second pattem and zice versa. 

Each handset MS 1,2,3 is provided with intemal back- lighting or is externally 
lit in order to illuminate the LCD device 5. As shown in Figure 2, the back- 
lighting is provided by light emitting diodes 20 which are typically arranged 
along at least one side edge of the display device 5 so as to shine Ught 
transversely into the display device between the glass plates 15,16. 

In use, the camera 11 captures first image data corresponding to the first test 
signal pattern produced by the generator 10. The camera 11 subsequently 
produces second image data corresponding to the second test signal pattern. 
The first and second image data are subtracted in order to identify any non 
ftmctional pixels of the display device 5. 

Referring to Figure 4, at the pixel location i,j, the camera 11 captures an image 
intensity value xij for the first test pattern of signal generator 10. The image 
data X is for example a quantized value between 0-255. 



For the second test pattern from generator 10, the camera 11 detects 
corresponding image data yi,j. 

As previously explained, the pixel at location i,j is switched on for one of the 
test signal pattems and is switched off for the other test pattern. If the pixel 
is functioning correctly, the values of x and y will differ substantially from one 
another, whereas if the pixel does not operate, the values will be substantially 
the same. The processor 12 computes the resultant data r corresponding to 
the absolute difference between the values of x and y for each pixel, where: 

ri.j = abs(xi.j - yij) (1) 

The processor 12 computes the value of nj for all the pixels in the captured 
image. A map of the resulting data is shown in Figure 5, in the i,j plane. It 
will be understood that the value of r,,j will be relatively large for a fully 
functional element (i, j) of the device, and relatively low if the element is 
faulty For a faulty element, the data xi,j and y, j for the first and second 
captured images will be constituted by static data i.e. data which does not 
change substantially between the capturing of the first and second images, the 
static data being determined by the level of illumination from the back lights 
20 or the extemal source. The value of the static data will vary from element 
to element in a non- linear manner due to the non- linear illumination and 
other factors. Nevertheless, such static data is cancelled out when the 
resultant is computed. 

Next, the processor 12 computes a summation of the resultant values for 
each column of pixels i, i.e. between 0 and jmax shown in Figure 5. The 
resultant sum n is given as follows: 
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ymax 

J=0 

(2) 

Figure 6 illustrates an LCD device 5 in which the column of pixels 
corresponding to electrode 17* has failed. Figure 7 is a graph of the 
corresponding summation values xi for the columns i across the display and it 
can be seen that there is an abnormally low value of zk corresponding to a 
location of electrode 17", which includes a fault. 

Thias, it is possible to detect manufacturing process faults by comparing the 
value of zt column by column with a reference threshold. A fault is detected if 
the value of t| is less than the threshold. 

It is possible to compare the value of n with a fixed threshold as illustrated by 
hatched line 21 in Figure 7. However, as shown by the graph 22, in practice, 
some non-linearities occur. In this example, the illumination provided to the 
device 5 by the light emitting diodes 20 is non-Unear over its display area, so 
that the graph 22 has a general drift downwardly towards the right of the 
graph. Furthermore, it will be understood that other sources of illiunination 
will produce different general graph shapes for the graph 22 e.g. sloping 
downwardly to the right or other shapes. As a result, there is a risk that a 
fixed threshold 21 will not provide a reliable reference. 

A plot 23 of an improved reference value ti, which foUows the general locus 
of plot 22 can however by computed from the mean and standard deviation of 
the values of , as will now be explained. Considering the mean V , this can 
be computed from n values of v as follows: 



- 10- 



1 ''+"-1 




(3) 



From Figure 7, it will be seen that the resulting mean ^.comprises a mean of 
2n values of zi disposed symmetrically aroimd the value zi\ 

A corresponding standard deviation a can be computed as follows: 



where ^ is a constant. 

The resulting plot of the threshold t, namely plot 23 in Figure 7 shows that 
the value of the threshold generally follows the plot of zi 22 and where the 
value of sharply drops as a result of an electrode malfunction, the threshold 
t does not commensurately drop and thus can be used as an appropriate 
reference to detect the malfunction. 

In practice, an appropriate value of n is 21 and the constant k may be set to 
0.18. However, the invention is not restricted to these particular values. 
Furthermore, it will be understood that the variable threshold t can be 
computed according to formulae other than equation (5) so long as the 
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The variable threshold ti' is defined by the following equation: 



(5) 
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threshold is slowly varying relative to rapid changes in the value of zi that are 
associated with a failed electrode of the device 5 

In addition to the summations for the vertical columns n, a corresponding 
summation is carried out for each horizontal row of values r„j shown in 
Figure 5, as follows: 



The values of hj are processed in a similar way to the vertical column values Vi. 
The corresponding threshold tj is computed based on the corresponding 
values of o\ and /where; 
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and: 
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tj-=kaj-l- r (9) 

The overall process of image capture and processing of the image data is 
5 shown schematically in Figure 8. At step S8.1 the first test pattern is appUed 
by the test signal generator 10 to the handset MS under test and camera 11 
captures the image data corresponding to the first test pattern, i.e. xi,j. 

At step SB. 2, the second test signal pattern is applied by the generator 10 to 
the handset and corresponding data is captured by camera 11 for the second 
test pattem namely data yg. 

At step S8.3, the data x,y are subtracted to compute for all pixels of the 
captured image, according to equation (1). 

At step S8.4, the summation is computed for all columns of the data ri,j and, 
in step S8.5, corresponding summations hj are computed for rows of the data 
ri,j. 

20 Then, for each computed value of zi, at step S8.6, a corresponding threshold ti 
is computed. At step S8.7, the computed threshold value ti is compared with 
the value of vi. If the summation value vi exceeds the threshold value ti, the 
data is considered to be satisfactory. However, if the computed value of n 
does not exceed the corresponding threshold ti, then, at step S8.8, a fail flag is 

25 set. 

Considering the computed values of hy a corresponding threshold value tj is 
computed for each value of hj at step S8-9. Each value of hj is then compared 
with the corresponding threshold value tj at step S8.10 and if it exceeds the 
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threshold, the data is considered to be satisfactory. Otherwise, a fail flag is 
set at step S8.ll. 

A determination is made at step S8.12 of whether the fail flag has been set at 
either step SB. 8 or S8.ll and if so, output data is provided at step S8.13 
indicating that the LCD device 5 is faulty. Otherwise, it is indicated to have 
satisfactorily passed the testing process at step S8.14. 

Many modifications and variations fall within the scope of the invention. For 
example, whilst the testing is being described in relation to a mobile telephone 
handset it can be carried out for any item of electronic apparatus including an 
LCD display. Also, the display device need not necessarily be an LCD but 
could comprise a plasma display or other display device utilising arrayed 
energisation electrodes. Furthermore, the display device can be tested 
according to the invention separately from the apparatus into which it is 
eventually installed. Thus, the LCD device 5 could be tested before 
installation into the handset MSI. Also, different types of illumination for the 
display device can be used. Thus, instead of the described back- lighting, front 
illumination and other forms of illumination can be used as will be evident to 
those skilled in the art. 

Typically the display device is monochrome but the invention can also be 
used with colour display devices. 



